AN EXPERIMENT IN PARTITIONING SECOND-GRADE 
MATHEMATICS CLASSES INTO SMALLER SECTIONS OF 
COMPARABLE ABILITY 






Theodore Thomas Bean 













T H E S I & 



j 



AN EXPERIMENT IN PARTITIONING SECOND-GRADE 
MATHEMATICS CLASSES INTO SMALLER SECTIONS OF 
COMPARABLE ABILITY 



u v 



Theodore Thomas Bean 
Thesis Advisor: 

September 1971 



R. R. Read 

tT5Tlt)0G 



Approved Lon pah tic xcfcaie; distu button ujitunitcd. 



An Experiment in Partitioning Second-Grade 
Mathematics Classes into Smaller Sections of 
Comparable Ability 

by 



Theodore Thomas ^Bean 
Captain, United States Marine Corps 
B.S.C.E., University of Mississippi, 1966 



Submitted in partial fulfillment of the 
requirements for the degree of 



MASTER OF SCIENCE IN OPERATIONS RESEARCH 



from the 



NAVAL POSTGRADUATE SCHOOL 
September 1971 



C.' 








ABSTRACT 



The mathematics program of an elementary school was 
changed so that the classes were partitioned into smaller 
sections of comparable ability. This change reduced the 
pupil -teacher ratio and the length of the instruction 
period. The proposal produced an unanswered question: 

Will there be an increased achievement gain during the 
school year which can be attributed to the program change? 
Two schools served as control groups for the experiment. 
The California Achievement Test, 1970 Edition, was used 
in a pretest -posttest design to measure achievement levels 
before and after the elapsed time of the experiment. The 
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various statistical techniques: randomized matched subjects 

design, analysis of covariance and the non-paramet ric xMann- 
Whitney U test. The several techniques were applied since 
no single standard practice was available for this problem. 
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I. INTRODUCTION 



On September 15, 1970, the author attended a PTA meeting 
at his child's school. The primary purpose of the meeting 
was to discuss a proposal for a change in the mathematics 
instruction at the second grade level and to obtain the ap- 
proval of the parents involved. 

The proposal was primarily directed at the large pupil- 
teacher ratios, approximately 30 to 1, existing in the five 
second grade classrooms. Essentially, the pupils in the 
second grade would be divided into ten sections (vice five 
classes) , with five of the sections being taught in the morn- 
ing and five in the afternoon. The same five classroom 
teachers would be teaching both sessions. The pupil teacher 
ratio would be virtually halved by the proposed change. Also 
the smaller sections were to be composed of pupils of com- 
parable ability. The parents were unaware of this aspect of 
the proposal. 

A scheduling problem was inherent in the proposal due 
to the morning and afternoon sessions and the limited number 
of teaching hours available during the day. This problem was 
solved by having the second graders arrive and depart the 
school at times different from the normal school routine and 
by reducing the normal 40 minute math period to 30 minutes 
in the morning session and to 35 minutes in the afternoon 
session. These scheduling changes allowed the teachers to 
remain within their allcted teaching hours. 
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The main point of concern to the parents centered 
around the possible inconvenience caused by the different 
arrival and departure times of the second graders involved. 
In the discussion that followed it was implicitly assumed 
that the achievement level of the pupils would be higher 
under the proposed change; this assumption was never ques- 
tioned. The primary reason for the assumption was the re- 
duced pupil - teacher ratio made possible by the increased 
number of sections. The reduction of the math periods by 
ten minutes in the morning session and five minutes in the 
afternoon session was not felt to be significant by compari- 
son . 



The proposal was adapted and implemented the following 



VvCCK Vv j. 1 1 1 o u l l h e v. uo s v. j. oi 2 



Increased achievement being 



considered. The objective of this thesis, then, is to de- 
termine if there was a significant increase in mathematical 
ability of the second graders involved which could be at- 
tributed to the change in mathematics instruction. 

Measuring and evaluating growth objectively is a clas- 
sical problem in psychometrics. It has been debated exten- 
sively in the literature by Lord [Ref. 1, 2, and 3], McNemar 

[Ref. 4], Cronbach and Furby [Ref. 5] and others. Reference 
6 is a collection of papers all dealing with the same problem 
- change: hew to measure and evaluate it. Cronbach and Furby 
have even gone so far as to suggest that measurement of 
change should not be done. They do present a model for ana- 
lyzing individual change which they consider b tter than 
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other available models, but they recommend that the results 
be interpreted with caution. The purpose here is neither to 
add nor subtract from the sometimes analytical, sometimes 
philosophical, arguments found in the literature but to pro- 
ceed with models that have been used in the past to measure 
and evaluate change. 

It was probable that mathematical skills would increase 
over the school year with or without the implementation of 
the proposal. This created a problem in isolating that por- 
tion of achievement, if any, due to the adopted proposal. 
This and other extraneous factors led to the selection of a 
control group. Two requirements were considered necessary 
for the control group. The first was that the pupils be 
assignee to classes m she iiO j iiiux x y accepLcu. marines ana 
that classes not be divided into smaller sections. The sec- 
ond requirement was that the pupils in the control group be 
of comparable ability with those in the experimental group. 
The first requirement seemed easy enough to satisfy, but 
the second seemed very difficult without prior knowledge of 
mathematical ability of both groups. 

An objective measuring device was also needed to mea- 
sure mathematical ability. The most commonly accepted way 
of measuring knowledge in educational institutions is by 
the use of tests, be they written, oral, or other. It was 
decided to give a written pretest and posttest to both the 
experimental and control groups. It was felt that this pre- 
test -posttest design would alleviate some of the difficul- 
ties in meeting the second requirement mentioned above. 
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Fortunately, the author was referred to CTB/McGraw- 
Hill , Monterey, California, by his thesis advisor. Douglas 
J. McRae, of the research department of that firm, took an 
interest in this project. Upon his urging, the firm agreed 
to furnish their California Achievement Tests, 1970 Edition, 
to the schools involved. Consultation with Mr. McRae and 
the principal of the experimental school also led to the 
selection of a control group. 

It is widely accepted that a positive correlation 
exists between socio-economic level and academic achievement 
It was, then, on the basis of assumed socio-economic level 
that the experimental and control groups were deemed to be 
of comparable ability. A questionnaire furnished by Mr. 
McRae was used by the author to establish the socio-economic 
levels of the ti^o groups. 

The experimental group happened to be in the largest 
elementary school in the area, so two schools were chosen 
to form the control group. This allowed the numerical popu- 
lation of the experimental and control groups to be of the 
same magnitude and the results to have a broader base. The 
principals of the two schools tenatively selected as the 
control group were contacted and both were eager to coop- 
erate in the experiment. The experimental school was la- 
beled school A and the control schools were labeled B and C. 
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II. PUPIL-SCHOOL BACKGROUND 



A School Characteristics Questionnaire [Appendix A], 
furnished by Douglas J. McRae of CTB/McGraw-Hill , was given 
to the principal of each school to complete. The question- 
naire requested information on a variety of pupil, staff, 
and physical plant characteristics. The schools were all 
considered to be located in residential suburbs. The per- 
tinent results of the questionnaire are presented in Table 
I. The number in parenthesis refers to the questionnaire 
item . 



school wruelment; 






i 


QUESTION AREA ~~~~ ~~~~ ■ — __ 


A (900) 


B (400) 


1 C (600) 



Si uPUi\ i DiuMwvj K-A.m j o : 



Mobil ity 


(2) 


35% 


10% 


15% 


PTA Attendance 


(4) 


20% 


20% 


10% 


Employed Mothers 


(6) 


5% 


25% 


40% 


Per Cent White 


(10) 


98% 


95% 


95% 


Kindergarten 


(13) 


7 C. ?- 

i O o 


100% 


100% 


One Parent 


(14) 


.2% 


5% 


10% 


English Second 


(15) 


.4% 


1% 


2% 


Professional 


(16) 


75% 


50% 


45% 


White Collar 


(16) 


15% 


30% 


37% 


Skilled 


(16) 


10% 


15% 


15% 


Unskilled 


(16) 


0% 


5% 


3% 


PHYSICAL PLANT AND 
ADMINISTRATIVE: 










Plant Age 


(3) 


17 yrs 


5 yrs 


20 yrs 


New Programs 


(8) 


2-5 mo s 


2-6 mos 


2-6 mos 


Library 


(17) 


7650 


- 


9000 


STAFF CHARACTERISTICS: 










Principal's Salary 


(ID 


$17,145 


$17,500 


$16,500 


Average Start Salary 


(12) 


7,500 


7,500 


7,500 


Average Salary 


(19) 


9,850 


- 


10,000 


Average Experience 


(18) 


7 years 


7% ears 


9 years 



TABLE I. RESULTS OF SCHOOL CHARACTERISTICS QUESTIONNAIRE. 
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It is apparent that the schools differ in several 
areas (e.g., mobility, employed mothers, and the number of 
one parent homes) . There is an apparent positive correla- 
tion between the per cent of working mothers and the per 
cent of homes with one parent. The experimental school 
had a lower percentage of pupils who had attended kinder- 
garten. This agreed with the higher mobility figures for 
that school, as it is plausible that a large percentage 
of the pupils came from a school district outside of 
California, where kindergarten is not required. Two of 
the schools (A and C) have considerably older physical 
plants, but all three schools maintain a clean, neat ap- 
pearance conducive to learning. 

in o tiier areas the scnoois were very simxxar. Tney 
were homogeneous racially; at least 95 per cent of the 
pupils from each school were white. They were all members 
of the same school district; hence they had the same mini- 
mum math program [Appendix B]. The average experience of 
the teaching staff was between seven and nine years. At 
least 80 per cent of the pupil’s parents were in white- 
collar or professional occupations. From this it can be 
assumed that the socio-economic level of the three schools 
was approximately the same, partially confirming the basis 
on which the control schools were chosen. 
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III. ASSIGNMENT TO CLASSES AND INSTRUCTIONAL LEVELS 



The school district had set forth a statement of mini- 
mum goals and skills to be achieved by the second grade in 
mathematics [Appendix B] . All three schools involved in 
the experiment used Modern School Mathematics - Structure 
and Use , published by the California State Department of 
Education, as the basic text. This text adequately covers 
the minimum requirements and exceeds them, continuing into 
multiplication. More advanced texts are available for the 
gifted child, who is allowed to proceed at an accelerated 
pace. The advanced texts extend the concepts covered in 
the basic text and introduce the pupil to division. 



In the experimental group, pupils were initiall 



: - 1 1 - - ^ . 
‘ y cX : 



signed to one of ten mathematics sections on the basis of 
reading performance and a departmental math test. Some as- 
signments were changed at two different times during the 
school year. The first shift occurred after the pretest 
was given. The pupils who scored way above the average for 
their section were shifted to an appropriate section. No 
pupils were transferred to a lower section on the basis of 
the pretest. 

The second assignment change occurred during the mid- 
dle of the school year. Several pupils transferred to and 
from the school. Persons in authority felt that the new 
pupils should not be placed in advance sections; not enough 
information was available for basing the higher assignment. 
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Hence new students were placed in the lower sections. The 
better pupils in the lower sections were shifted to ad- 
vanced sections to keep the pupil - teacher ratios compar- 
able. It was felt that by shifting pupils in this manner 
no one would be in a section in which the material presented 
was beyond his capability. Unfortunately, the records as 
to which pupils were shifted are not complete. This led to 
a difficulty in interpreting the data, and the question is 
addressed later in the thesis. 

Five of the sections were taught during the morning 
and five during the afternoon. This division of the five 
second grade classes into ten sections automatically re- 
duced the pupil-teacher ratio and, as noted previously, 
grouped pupils of compaiable ability in the same section. 
This sectional assignment by ability allowed the teacher 
to present instruction at the average achievement level of 
their section rather than the average level of the second 
grade taken as a whole. 

Basically, there were five levels of instruction at 
the experimental school. Level I was taught at an advanced 
level to include multiplication and division. Levels II 
and III were taught at progressively lower levels. Level 
IV was considered to be composed of pupils who were capable 
of learning at the normal second grade level. This group 
was introduced to multiplication near the end of the school 
year. Level V consisted of the under-achievers. They were 
taught at the second grade level but with a more repetitious 
learning process and extensive drills in fundamentals. 
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In the control schools, levels were not used. Children 
were assigned to class more or less at random; there was no 
distinction made between slow and fast achievers. During 
the school year the level of instruction was based upon the 
average level of achievement within the class. The teachers 
gave special assistance to those children who were lagging 
and to those who were capable of progressing more rapidly. 
This assistance allowed the pupils in the control schools 
to have essentially the same range of instruction as that 
of the pupils in the experiment group. 

The division of the five classrooms in the experimental 
school into ten sections formed the basis for the experi- 
ment. These sections allowed for five different levels of 
instruction ind a reduce cl pupil “teacher ratio 01 i 5 to i 
for levels I, II, III, and IV and 10 to 1 for level V. 

This is to be contrasted i^ith the control group schools 
where pupils were assigned more or less at random to a class 
one general level of instruction prevailed, and the pupil- 
teacher ratios were approximately 25 to 1 and 30 to 1 in 
schools B and C respectively. Further, the pupils in the 
experimental school were being taught five or ten minutes 
less per day 1 than the pupils in the control schools. 



i 

Ten minutes for the morning classes and <.ive minutes 
for the afternoon classes. 
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IV. THE CALIFORNIA ACHIEVEMENT TEST 



The experimental and control groups participating in 
the experiment and the experiment itself have been described. 
Information was presented which indicates that the pupils 
involved were of the same socio-economic level. Presumably, 
then, the pupils of the different schools were, on the aver- 
age, at the same level of learning at the start of their 
second grade year. It is recognized, however, that the 
maturity level of second graders can range from kindergarten 
to the third or fourth grade, i.e., it was not assumed that 
all pupils had reached the same level of academic achieve- 
ment . 



Considering tne similarity oi starting levels, men , 
one would expect the same magnitude of achievement in math- 
ematical skills during the second grade school year for 
both groups, if there were no real difference between the 
math programs of the experimental and control groups. 

As mentioned previously, the California Achievement 
Test, 1970 Edition, was the measuring device used to measure 
the achievement level at the beginning and end of the exper- 
iment. The test is designed for the measurement, evaluation 
and analysis of school achievement in the three basic skill 
areas: reading, mathematics, and language. 

These three skill areas are measured separately. The 
math section of the CAT measures [Ref. 7]: 

"-the ability to understand the meaning of the material 
presented , 
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-the performance of the student in applying rules, 
facts, concepts, conventions, and principals of 
problem solving in the basic curricular material, 
and 

-the level of performance of the student in using 
the tools of mathematics in progressively more 
difficult situations." 

How well does the CAT measure mathematical achievement? 

This question is partially answered by Reference 8. Further 
information, based upon national standardization data, will 
be available when the Technical Report, California Achieve - 
ment Test, 1970 Edition , [Ref. 9], is published. The author 
has had limited access to this material through Mr. McRae, 
and from all reports the test is well established. 

Reference 7 contains tables to assist in transforming 
raw scores (total number of right responses) into Achieve- 
ment Development bcaie Scores (ADSS) . The scale scores 
were produced by applying the Thrustones absolute scaling 
procedure to the standardization data [Ref. 8 and 10] . 

There are five levels of the CAT designed to cover grades 
one through twelve. The scale scores have the advantage 
of being articulated across all levels of the CAT, i.e., 
theoretically a first graders achievement can be compared 
with that of a student in high school. Further advantages 
of scale scores over raw scores are that they have interval 
scale properties and are normally distributed [Ref. 8] , 
Hence, these scores are advantageous for use in statistical 
analysis of the measurement of growth, trends, etc. 

There are two levels of the CAT which pertain to the 
second grade. Level 1 is designed to test pupils in the 
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first and second grade. Level 2 covers the second through 
fourth grade, thus overlapping level 1 at the second grade. 

It was decided to give level 1 at the beginning of the school 
year and level 2 at the end of the school year. The reason 
two levels were chosen instead of using level 1 twice, was 
to allow for maximum spread of the scores over the learning 
period and to avoid practice effects. Interlevel articula- 
tion is a correlation measure of how well the different 
levels measure the same attribute (in this case, mathemati- 
cal achievement) at the overlap of the levels. The interlev- 
el articulation coefficient for levels 1 and 2, CAT, 1970 
Edition, is .78 [Ref. 9]. 

Level 1 of the CAT was given to all participating 
schools during the second week of October, .1 970. Level 2 
was given during the third week of May, 1971, an elapsed 
time of seven months. The tests were given, monitored 
and scored by the schools in accordance with Reference 7. 

The raw scores were collected by the principals of the 
participating schools and given to the author within a rea- 
sonable period of time after each testing period. 

Each level of the CAT mathematics section is divided 
into two parts: concepts and computational ability. The 

raw scores of each area were kept separate. The author 
converted the raw scores into scale scores. These scores 
for all pupils are contained in Appendix C. 
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V. METHODS OF ANALYSIS 



The stated objective of this thesis was to measure the 
achievement gain in mathematical skills of three different 
sets of pupils, compare these measures and determine by 
some means whether any one of these measures is significant- 
ly different from the others. As noted in the Introduction, 
a standard mode] for answering this question has not been 
obtained to everyone’s satisfaction. 

Hence, due to a lack of a totally defensible mathemati- 
cal model, several statistical techniques were applied to 
the data. This use of several techniques had the advantage 
of compensating for weaknesses in different procedures and 
Ox developing e xp erience m x n c v 3. x x o u s sihiis iiCcii x. c cn j i j ti e • 
Naturally the results would be highly correlated and the re- 
inforcing value of a second or third successful procedure is 
slight (one should not perform multiple tests on a single 
set of data). Joint probability statements cannot bo made, 
only individual (or marginal) ones. It was still held to 
be valuable to have the several tests as backups for one 
another. The three models used in the analysis were the 
Randomized Matched Subject Design, the Analysis of Co- 
variance, and the non-parametric Mann-Whitney U Test. The 
reader is asked to judge for himself as to which technique 
supports the experimental paradigm. 



A. RANDOMIZED MATCHED SUBJECT DESIGN [Ref. 11 and 12] 

In this test there must be an equal number of pupils in 
the experimental and control groups. Schools B and C were 
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combined to form a control group of 113 subjects. School A 
had 94. Random number tables were used to discard the 19 
excess pupils from the control group. After the pretest 
was given, the pupils were ranked within the experimental 
and control groups on the basis of their pretest score. 

The two groups were then paired by placing the pupil scor- 
ing highest in the experimental group with the pupil scor- 
ing highest in the control group, etc., until 94 pairings 
were obtained. After the posttest w as given and scored a 
difference score was obtained on each pair in the following 
manner : 



D. 

i 





(x E - x c ), 

J i i 



where 

X r = pretest of i^h pupil in the control group 
L i 

= posttest of ith pupil in the control group 
i 

= pretest of i^* 1 pupil in the experimental group 

l 

Yp = posttest of i^h pupil in the experimental group. 
i 

With a difference score thus defined, the question of 
whether or not the program of the experimental group was 
better than that of the combined control group can be ad- 
dressed with the following statistical hypotheses: 



H : y = 0 
o 

Hp : y > 0 

where y is the mean of the difference scores. If during the 
analysis, H , the null hypothesis, is not rejected, this will 



20 



imply that no significant difference exists in the programs 
of the experimental and control groups. It was assumed 
that the difference scores had a normal distribution with 
a mean of zero and an unknown variance. Under these as- 
sumptions, the Student-t distribution yields the uniformly 
most powerful test against all one-sided alternative hypoth- 
eses. It was used in this thesis to test the null hypothe- 
sis presented above. 

The randomized matched subjects design has a distinct 
advantage over a design \-/here the difference between the 
estimated gains made by the experimental and control groups 
is hypothesized to be zero. The pairing on the pretest 
scores introduces a high correlation between the groups on 
posttest scores. This correlation decreases the estimate 
of the variance by an amount equal to twice the covariance 
of the means. Thus the randomized matched subjects design 
is more sensitive to differences between the two groups 
than a design where pairing is not done, since the denomina- 
tor of the critical ratio is reduced. 

The primary disadvantage of the randomized matched sub- 
jects design is that an implicit assumption is made, i.e., 
the scores obtained on the protests and posttests are true 
scores. In reality the obtained score on any test can be 
thought of as a true score plus error, where the error can 
be modeled as a normally distributed random variable with 
zero mean and unknown variance. The difference score for 
each pupil, as defined, is the difference of two normally 
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distributed random variables. The sum of these differences 
has a normal distribution but the variance may change from 
pupil to pupil. Thus the Student-t procedure will estimate 
a variance which is actually a composite of each students 
variance rather than the value common to all. Hence this 
procedure for comparing growth may be questioned. 



B. ANALYSIS OF COVARIANCE [Ref. 13] 

The second method used in the analysis of the different 
mathematics program was the Analysis of Covariance. In the 
analysis the posttest score is considered to be dependent 
upon the pretest score, which is called the concomitant 
variable. The Analysis of Covariance takes advantage of 
the information furnished by the concomitant variable in a 
sense that the posttest scores are "corrected" by taking 
into account the differences between the groups on the 
concomitant variable. After the posttest scores are "cor- 
rected" the procedure reduces to a straight analysis of 
variance. Thus the results from the analysis of covariance 
more accurately reflect any differences that are due to the 
different programs than a straight analysis of variance 
would on the posttest scores. 

The assumptions of the analysis of covariance are: 

1. A random sample of size one is drawn from each of 
N populations. 

2. Each of the populations is normal and has the same 
variance . 
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3. The population means within each group lie on a 
straight line and the slope of the line is the same for each 
group . 

Since the concomitant variable is measured with error (i.e., 
the obtained scores are not necessarily true scores) it 
must also be assumed that the assumptions hold for all pos- 
sible values of the concomitant variable. 

The model for the analysis of covariance can be writ- 
ten as : 



y. . = u + 0. + y (x.. - be..) + e.. 1 1,2, "' ,n j 

ij 3 13 11 

j=l ,2, . . ,r 

j - N( 0 ,a 2 ) 



Z n . 3 . - 0 N = v 

1 3 

1 = 1 j=l 



> n . 
L. 3 



where 



r 



n . 

3 



x. • 



y 



ii 

b j 



Y 

y 



the number of schools. 

the number of pupils in the j t ^ 1 school, 
pretest of i t ^ 1 pupil in the jth school, 
posttest of i^ pupil in the j school, 
program effect of j t ^ 1 school. 

slope of regression line (posttest on pretest) . 
the average of all r population means. 



The objective of the analysis is to choose between the 
following set of hypotheses: 




B j 3 1=1,2, 

not all 3. are the same 



>r. 
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The null hypothesis implies that the corrected program ef- 
fects are all equal. 

The robustness of this test is not as well known as 
that of the straight analysis of variance. Feldt [Ref. 14], 
in a paper comparing several techniques, stated that the 
number of assumptions required for a valid analysis of co- 
variance renders the technique generally less applicable 
than other statistical tests used for the same purpose. 

The failure of the data to meet the assumptions is thought 
to be more serious in analysis of covariance than in straight 
analysis of variance (the Student-t in the two sample case) 
especially with failure to satisfy regression assumptions. 

Feldt investigated the precision of a factorial design 
and of the analysis of covariance. He discovered that for 
regression correlations of greater than 0.6 analysis of co- 
variance has the greater precision. Since CTB/McGraw-Hill 
has estimated this correlation (their interlevel of articulation) 
to be 0.78 2 in their standardization procedures, it was 
believed that the analysis of covariance in this thesis 
would yield valid results. 

C. MANN -WHITNEY U TEST 

A third test was presented for those readers unwilling 
to accept the assumptions in the analysis of covariance or 
the validity of the randomized matched subjects design. It 



See the r values in Tables IX and Figure 1 for values 
obtained during the analysis. 
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is the non-parametric Mann -Whitney U test. In this test it 
was again necessary to form the two control schools into 
one, but it was not necessary to delete the 19 pupils as 
in the randomized matched subjects design. The achieve- 
ment gain score (posttest -pretest) was computed for all 
pupils. Again the thesis in question could be answered by 
a set of hypotheses 



H : The achievement gains for the experi- 

mental and control groups have the 
same distribution. 

H, : The achievement gains for the experi- 

mental group are stochastically larger 
than those of the control group. 

There are no assumptions made as to the distribution 
of the achievement gains other than the distributions are 
continuous ana t n a z me ooscrvanuus ax*e coiuproLery .l n ue - 
pendent . Siegel [Ref. 15] states that the power efficiency 
of the Mann-Whitney U test approaches 95.5 per cent for 
large sample sizes compared to the Student- t. It is, there- 
fore, an excellent alternative to the Student-t, and it 
does not have the restrictive assumptions associated with 
the analysis of covariance. 
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VI. INITIAL RESULTS 



The set of hypotheses presented in each of the three 
different techniques of analysis were all designed to ans- 
wer the sane question: Was the achievement level in math- 

ematics of the pupils in school A larger than the gain 
normally attributed to the learning process during the sec- 
ond grade? If the null hypothesis was not accepted during 
the analysis it would be a strong indication that the change 
in mathematical programs at school A contributed signifi- 
cantly to the gains made by the pupils. If the opposite 
occurred, it could be concluded that the program had no 
significant effect. 



a cnievement Development bcaie Scores were used in ail 
statistical analysis and the significance level of all 
tests was arbitrarily set at the S per cent level. This 
significance level is the probability of a Type I error, 
i.e., the probability that the null hypothesis is rejected 
when in reality it is true. The power of the tests, i.e., 
the probability of failing to reject the null hypothesis 
when the alternative is true, were not determined. 

All three statistical techniques discussed were used 
on the total test score and each of the subtest scores, 
i.e., grasp of concepts and computational ability. The 
basic results are presented in Table II. The table includes 
the estimates of the mean and standard deviations for each 
of the three scores. The remaining results in his section 
apply only to the total scores. 
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In the randomized matched subject design, the estimate 
of the mean of 94 difference scores was 24.4. The sample 
standard deviation was 48.7. These figures combined to 
yield t = 4.86 > 1.99. Hence the null hypothesis was re- 
jected. 

The results of the analysis of covariance are con- 
tained in Table III. F = 13.03 > 3.00, hence the null hy- 
pothesis was rejected. The rejection of the null hypothe- 
sis in the analysis of covariance only indicates that all 



SOURCE 



SS. 



SP 



xy 



SS 



y 



SS' 

y 



d . f . MS' 

y 



TREATMENT 528.4 3,814.1 37,606.9 30,165.2 2 15,002.6 
ERROR 150,788.5 157,041.1 398,519.6 234,966.5 203 1,157.5 
TOTAL 151,316.9 160,855.2 436 , 126.44 265.131.7 



TABLE III. ANALYSIS OF COVARIANCE, TOTAL SCORE. 



programs were not the same. A technique exists to determine 
which program or programs were significantly different.' A 
linear combination of the form 



3 

L = c 1 B a + c 2 3 b + c 3 B c , £>3 = 0 

j = l 

where the c.'s are constants, is called a contrast. Scheffe's 
J 

method [Ref. IS] was used to obtain confidence intervals for 
several contrasts and to determine which contrasts were sig- 
nificantly different from zero. 8^, i = A, B, C are the 
program effects of the different schools. The results are 
contained in Table IV. 



28 



CONTRAST 



INTERVAL 



b a' b b 


10.5 


V i 


L 


I A 


39.9 


6 a" B c 


10.0 


< 


L 


< 


37.0 


b b‘ b c 


-17.5 


< 


L 


< 


14.2 


CW 


11.8 


< 


L 


< 


35.2 



TABLE IV. CONFIDENCE INTERVAL FOR CONTRASTS, TOTAL SCORE. 

It is obvious from Table IV that school A is the reason the 
null hypothesis was not accepted. The confidence intervals 
associated with school A do not contain zero and are greater 
than zero. 

The Mann -Whitney U test yielded the same result, i.e., 
the null hypothesis was rejected. The achievement gain 
scores yielded a U statistic of 6884.5 (correction for 
ties was included) . This transformed into a normalized 
variate, z - 3.667. The probability of this occurring is 
0.0013 < 0.05. 
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VII. DISCUSSION OF THE RESULTS AND FURTHER ANALYSIS 



All three methods of analysis soundly rejected the 
null hypothesis. Hence, from the preliminary results, it 
was concluded that the division of classes into small sec- 
tions, composed of pupils of comparable ability, signifi- 
cantly increased the achievement gains during the second 
grade school year. 

At this point the author decided to determine if the 
programs were significantly different in both areas of the 
California Achievement Test. The analysis of covariance 
was chosen as the technique for further analysis based on 
the author's belief that it yielded the most information 
and Luat xt was oroaciez* casco, sxnce xne controx scLooxs 
were not combined. The results of the analysis of the con- 
cept scores are presented in Table V and computation scores 
in Table VII. The confidence intervals for contrasts are 
contained in Tables VI and VIII, respectively. 



SOURCE 



SS. 



SP 



SS 



SS' 

y 



d. f . 



MS' 



xy y 

TREATMENT 1,728.4 2,708.5 38,634.4 35,482.1 2 17,741.0 

ERROR 298,927.5 230,133.3 457,982.5 280,811.4 203 1,383.3 

TOTAL 300,655.9 232,891.8 496,616.9 316,293.5 

TABLE V. ANALYSIS OF COVARIANCE, CONCEPT SCORE. 



For concept scores the statistic F = 12.83 > 3.00, hence 
the null hypothesis was also rejected for concents, and from 
Table VI it is clear that school A was the reason. 
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CONTRAST 



INTERVAL 





B A" B B 


3.8 < 


L < 36.1 






B A _B C 


14.7 < 


L < 44.2 






B B _B C 


-7.9 < 


L < 26.7 






e A _Js ^B + e C- ) 


12.0 < 


L < 37.5 




TABLE VI . 


CONFIDENCE INTERVALS FOR CONTRASTS, 


CONCEPT SCORE 


SOURCE 


SS SP 

x xy 


SS 

y 


SS' 

y 


d.f. MS' 

y 


TREATMENT 


392.6 3,363.3 


29,037.6 


23,948.9 


2 11,974.4 


ERROR 


122,137.1 95,356.0 


320,972.5 


250,525.3 


203 1,239.1 


TOTAL 


122,529.7 98,719.3 


359 ,010.1 


274,479.2 




TABLE VII 


. ANALYSIS OF COVARIANCE, COMPUTATION 


SCORE. 



CONTRAST 


INTERVAL 




b a' b b 


9.8 


< L 


< 


40.1 


b a' b b 


4.0 


< L 


< 


32.0 


b b" b c 


-23.3 


< L 


< 


9.4 


MVB C ) 


9.4 


< L 


< 


33.6 



TABLE VIII. CONFIDENCE INTERVALS FOR CONTRAST, COMPUTATION 
SCORE. 



From the analysis presented, thus far, it is clear that 
the program at school A allowed for sizeable achievement 
gains in all math areas of the CAT. A regression of the 
posttest scores on the pretest scores, total scores, was 
done to see how well the analysis of convariance assumptions 
were met. The results are contained in Table IX. The 
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slopes of the regression equations were within reason for 
all of the schools, but the correlation was low for school 
A 3 . Histograms were made for all three schools on the pre- 
test and posttest total scores. All appeared to be normally 
distributed except the posttest scores of school A. A bi- 
modal distribution appeared, and further analysis was sug- 
gested. 



SCHOOL 


REGRESSION 


EQUATION 


CORRELATION 


A 


Y = 


18.27 


+ 1.16 X 


0.545 


B 


Y = 


- 4.40 


+ 1.15 X 


0.808 


C 


Y = 


75.93 


+ 0.87 X 


0 . 750 



TABLE IX. REGRESSION ANALYSIS ON TOTAL SCORES. 

An investigation was begun to see if the apparent bi- 
modal distribution of posttest scores of school A was as- 
sociated with the section assignments. At this time it was 
discovered that complete details of final section assign- 
ments were not available. The final assignments were dif- 
ferent from the original because of shifts during the school 

\ 

year. The reason for the shifts were explained in detail in 
Section III of this thesis. The assistant principal and the 
only available teacher concerned with the experiment assisted 

3 It is possible, through statistical techniques, to test 
the slopes for equality and to obtain confidence intervals 
for the correlation. Equality of slopes was assumed in the 
Analysis of Covariance and the tests were not done to avoid 
debate about the significance level of the Analysis of Co- 
variance . 
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the author in verifying 79 (out of 94) of the final assign- 
ments. This information was not considered to be complete 
enough for further analysis. 



A cluster analysis computer program was obtained from 
Mr. McRae [Ref. 16] to separate the pupils into clusters 
based on their test scores. The program contained several 
different methods to accomplish this. Two of the methods 
were used with identical results. The program separated 
the pupils of school A into two clusters; basically, the 
clusters consisted of levels I and II, labeled cluster A; 
and levels III, IV, and V, labeled cluster B. Since 79 
of the final assignments were known, it was easy enough 
to verify the soundness of the routines. Four errors 



Tl. ...... 

X il X W JL/ UjJ - 



nno »» v/ i i« ii c u u v xu 



A were assigned to B and one who was known to be in cluster 
B was assigned to A. The author considered the number of 
known errors to be sufficiently small to avoid appreciable 
discrepancies in further analysis. 

Another Analysis of Covariance was run on the total 
scores. This time four groups were included in the analy- 
sis: School A-cluster A, school A-cluster B, school B, 

and school C. The results are presented in Tables X and 
XI. 



The statistic F = 99.29 > 2.6. Hence the null hypothesis 
was rejected. It is clear from Table XI that the scores from 
school A-cluster A accounted for the rejection of the null 
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hypothesis. Cluster A consisted of these pupils assigned 
to levels I and II where the level of instruction was the 
most advanced. 

SOURCE SS x SP xy SS y SS y d.f. MS^ 



TREATMENT 


10,539.9 


48,806.3 


239,804.1 157,992 


.7 3 52,669.2 


ERROR 


140,777.0 


112,048.9 


196,322.3 107,139 


.0 202 530.4 


TOTAL 


151,316.9 


160,855.2 


436,126.4 265,131 


. 7 


TABLE X. 


ANALYSIS 

SEPARATED 


OF COVARIANCE, TOTAL SCORE. 
INTO TOO CLUSTERS. 


SCHOOL A 






CONTRAST 


INTERVAL 








B AB _B B 


-13.5 < L < 


11.0 






B AB- g C 


-15.0 < L < 


7-9 






B AA _B B 


64.4 < L < 


94.3 






6 AA _B C 


62.8 < L < 


91.1 






B AA _B AB 


66.0 < L < 


95.0 






B B " B C 


-14.5 < L < 


9.9 



TABLE XI. CONFIDENCE INTERVALS FOR CONTRA.ST , TOTAL SCORES. 
SCHOOL A SEPARATED INTO TWO CLUSTERS. 



The scatter diagram for school A is shown in Figure 1. 

The regression equations and correlations for the school as 
a whole and separated into clusters are shown on the figure. 
The correlation of the pupils in cluster B increased to 0.823, 
while the correlation of the pupils in cluster A decreased to 
0.124 . 
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FIGURE I. SCATTER DIAGRAM AND REGRESSION ANALYSIS, SCHOOL A. 




PRETEST SCORE 



SCHOOL A 

Y- 18.27 + 1.15 X 
S y • 50.84 

Syix '^ 2 

r -0.545 



Y- 378.8+0.097 X 
S y -19.43 
S y|X -18.28 

r -0.124 



CLUSTER B 

Y- 129.48 + C.659X 
S Y - 30.43 
Sfl x “ '7-29 
r • 0.823 
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VIII. CONCLUSIONS 



In the Introduction it w as questioned whether a pro- 
posed change in a mathematics program would lead to in- 
creased math achievement. The author contends that thru 
statistical analysis this thesis established the increased 
achievement beyond a reasonable doubt. 

From the confidence intervals in Table XI, it is clear 
that no significant differences existed between cluster B 
of school A and schools B and C; the confidence intervals 
for the appropriate contrasts all contain zero. This re- 
sult, along with the information that cluster B at school A 
had a sample standard deviation of 30.4 on the posttest 
score, lea the author to conclude that no one was nurt oy 
the program. It afforded the slow achievers the opportunity 
to receive concentrated instruction at their level. The 
fact that the concentrated instruction at level V assisted 
those pupils to advance faster was reflected by the low 
variability of cluster B's posttest scores compared with 
schools B and C. 

As far as the author can ascertain from the analysis, 
the average student was unaffected by the program. It is 
readily apparent that those pupils in levels I and II re- 
ceived the greatest benefit. The means for levels I and 
II, on the posttest score, was above the 99^ percentile 
of the nation based upon the standardization data of the 
CAT. On the average, cluster A missed less th.n two questions 
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per child out of 117 on the posttest. This spectacular re- 
sult further suggests that cluster A could have scored even 
higher on an expanded test. Since the CAT was designed to 
be used through the fourth grade, the second graders are to 
be commended on their accomplishment. 

It may be questioned whether or not the teachers at 
the experimental school were concentrating their instruction 
in the area of the CAT. The author talked to one of the 
teachers in the experimental school and to the principals 
of all three schools. He was assured that "teaching to 
the test" was not done at any of the schools. 

It is noted, that, since the experimental teaching 
program was conceived and implemented by school A teachers, 

tiiO SO C a i i 6 d ?, iiaW LiiOTTiG O 1 10 C l ’ j KG T . 1/ j TTiciy fl a V 6 DGGTi 

operative. The results are quite striking, however, and 
the author feels that if such a program were administered 
by other teachers the improvement indicated here would not 
be diminished by any large degree. Finally, it is noted 
that none of the students at any of the schools were av r are 
of the experiment; only the teachers. 

It is hoped that this thesis is of some aid in keeping 
the program at school A; including the extension of it into 
the other elementary grades. It is further hoped that it 
can be used as a basis to implement the experimental pro- 
gram at other schools with the school district. 
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APPENDIX A: SCHOOL CHARACTERISTICS QUESTIONNAIRE 



1. How many students are enrolled in this school at each 
of the following grade levels: 

K 7 

1 8 

2 9 

3 10 

4 11 

5 12 

6 



2. About what percentage of the students who attended this 
school last year are no longer attending this school (do 
not count those who have moved because of graduation or are 
being bussed to other schools)? 



3. How old is the main classroom building of this school 
plant? 

years old. 



a * About what dot* cent 0 "f" 
school are represented at 
similar parent group? 



the f ami 3 ies of students 
a typical meeting of the 



3. t tb i c 
PTA or 



% 



5. Which of the following categories best describe the nei- 
ghborhood served by this school? 



a . 


rural 




b. 


residential suburb 




c . 


industrial suburb 




d. 


small town (5,000 or less) 




e . 


city of 5,000 to 50,000 




f . 


residential area of a large 
(50,000+) 


city 


g- 


inner part of a large city 


(50,000+) 



6. About what percentage of students in this school have 
mothers who are employed outside of the home? 



7. From which of the following groups (check all that apply) 
is formal approval required to initiate new education programs 
in this school (e.g., team teaching, new curricula, ungraded 
classrooms, resource rooms, etc.)? 
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Board of Education 

Superintendent 

District administration 

other than Superintendent 

Parents 

Teachers 

No formal approval needed 

8. About how long does it usually take to implement a new 
educational program in this school (i.e., from the time the 
decision is made to adopt it until the time it is actually 
introduced) ? 



months 

9. (a) (Elementary Schools) What is the copyright date of the 

regular class reading book used in the third grade at 
this school? 

(b) (Junior and senior high schools) What is the copy- 
right date of the regular American history text used 
in this school? 

10. About what percentage of the students in this school are 
white? 



11. What is the annual salary of the principal of this school? 

$ 



12. What is the starting annual salary of a fully certified 
beginning teacher in this school system? 

$ 

1 3 . (Elementary schools only) About what percentage of the 
students now in Grade 1 in this school attended Kindergarten 
or its equivalent? 



14. About what percentage of the students in this school are 
living in homes in which there is only one parent? 



15. About what percentage of the students in this school 
speak a langugage other than English outside of school or 
come from homes in which a language other than English is 
spoken most of the time? 
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16. About what percentage of the pupils served by this 
school fall into each of the categories listed in the 
chart below (the total should equal 100%)? 

Occupational Category % 

children of professionals and managers 
(doctors, lawyers, engineers, executives, 
etc . ) 

children of white collar workers other than 
those in (a) above (proprietors, salesman, 
clerks, etc.) 

children of skilled workers (electricians, 
carpenters, repair men, factory workers, etc) 

children of unskilled workers (laborers, 
janitors, dishwashers, etc.) 



TOTAL 100% 

17. About how many catalogued volumes are there in the li- 
brary of this school? 



volumes 

18. What is the average full-time teaching experience of the 
teaching staff of this school (consider counseling as teach- 
ing experience)? 



years 

19. What is the approximate average annual salary of the 
teaching staff in this school? 

$ 



20. Please estimate in the chart below the number of hours per 
week that each of the specified kinds of people are working 
in this school : 

Type of person # hours per week 

Guidance Counselor 
Psychologist 
Child Welfare and 
Attendance Office 
Nurse 

Speech Therapist 
Remedial Reading 
Specialist 
Eng lish- Second - 
Language Specialist 
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# hours per week 



Art Teacher 

Sex Education Consultant 

Librarian 

Teacher Aides 
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APPENDIX B: SCHOOL DISTRICT MINIMUM MATH PROGRAM - GRADE 2 



Students in the second grade 

-will be able to read numerals through 200 and write numerals 
through 100, and to count to 100 by l's and 10 's, and to 
20 by 5 ' s . 

-will gain a working knowledge of the concepts of numbers 0 
through 99 and be able to identify the number before and 
after a given number through 99. They will have some ex- 
periences with numbers 100 through 999 including the iden- 
tification of place value through the hundreds place. 

-will be exposed to number words through "ten." 

-will gain a working knowledge of the ordinal numerals first 
through seventh (using teacher-made materials) . 

-will be able to demonstrate an understanding that there are 
many ways to write the numeral for a given number. 



-will master the addition and subtraction combinations 
through 15, with emphasis on vertical notation, and will be 
a u x e l.u x.ujntxxc;ue cne audition an u suotruoixun souLonco£> 
within these number families. 



-will be able to demonstrate an understanding of and be able 
to add and subtract two-digit numbers which do not require 
carrying or borrowing. 

-will be exposed to and have some practice with addition of 
three-digit numbers with no carrying. 

-will be exposed to and have some practice with addition 
problems involving carrying and with subtraction problems 
involving borrowing. 

-will be able to demonstrate an understanding of, and be 
able to work addition problems with, three addends up to 
and including two-digit numbers. 

-will be able to demonstrate an understanding of the meaning 
of the mathematical vocabulary and symbols included in the 
minimum program for grade two. 

-will be able to demonstrate an understanding of and be able 
to work oral story problems using the concepts and skills 
mastered . 
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-will be able to demonstrate an understanding of the con- 
cepts of 1/2 and 1/4 and be exposed to 1/3 as part of a 
whole • 



-will be able to tell time to the nearest hour and half- 
hour . 

-will be able to use pennies, nickels, dimes, quarters, 
and dollars. 

-will have further exposure to a calendar and will develop 
further understanding of a day, week and month in measuring 
time . 
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1 

2 

3 

4 

5 

6 

7 

8 

9 

10 

11 

12 

13 

14 

15 

16 

] 7 

18 

19 

20 

21 

22 

23 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

34 

35 

36 

37 

38 

39 

40 

41 

42 
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APPENDIX C: TEST SCORES 



SCHOOL A 

PRETEST POSTTEST 

CONCEPTS COMPUTATION TOTAL CONCEPTS COMPUTATION TOTAL 



322 


303 


290 


333 


313 


310 


378 


293 


316 


444 


373 


397 


346 


258 


271 


333 


282 


288 


327 


235 


250 


42 8 


400 


405 


317 


260 


265 


464 


400 


426 


304 


317 


282 


464 


400 


426 


322 


276 


280 


402 


307 


322 


339 


280 


290 


393 


309 


322 


395 


317 


339 


428 


385 


397 


346 


273 


287 


428 


313 


331 


339 


286 


293 


428 


385 


397 


395 


317 


339 


464 


373 


405 


365 


293 


310 


402 


334 


348 


339 


293 


297 


444 


34 8 


375 


309 


286 


278 


384 


322 


331 


365 


286 


305 


402 


313 


327 


354 


263 


278 


384 


311 


322 


292 


268 


264 


444 


400 


415 


395 


293 


323 


488 


385 


426 


365 


293 


310 


488 


400 


437 


346 


286 


297 


384 


319 


329 


339 


268 


280 


364 


307 


315 


3t>5 


293 • 


310 


428 


400 


405 


354 


317 


316 


402 


373 


375 


354 


317 


316 


464 


385 


415 


263 


254 


244 


328 


288 


291 


339 


303 


301 


464 


400 


426 


300 


249 


252 


276 


299 


281 


339 


235 


252 


338 


278 


286 


296 


258 


257 


34 8 


299 


305 


296 


268 


265 


353 


256 


273 


309 


280 


2 76 


377 


326 


333 


36 5 


260 


276 


344 


326 


348 


283 


263 


257 


343 


311 


312 


39 5 


317 


339 


464 


400 


426 


332 


303 


297 


402 


338 


352 


275 


251 


246 


393 


267 


291 


304 


280 


274 


348 


286 


296 


327 


276 


282 


358 


297 


306 


309 


303 


282 


414 


301 


319 


263 


249 


240 


353 


25 8 


275 


296 


280 


271 


358 


303 


310 


292 


258 


256 


324 


288 


289 


292 


30 3 


2 74 


319 


280 


281 
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45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 

61 

62 

63 

64 

65 

66 

67 

68 

69 

70 

71 

72 

73 

74 

75 

76 

77 

78 

79 

80 

81 

82 

83 

84 

85 

86 

87 

88 

89 

90 

91 

92 

93 

94 



405 

289 

437 

437 

415 

382 

426 

426 

337 

329 

405 

397 

382 

329 

415 

405 

405 

303 

309 

329 

281 

294 

284 

319 

308 

315 

324 

329 

30 8 

278 

276 

325 

321 

297 

352 

288 

335 

331 

375 

331 

291 

276 

364 

324 

305 

331 

278 

405 

310 

286 



322 


263 


269 


428 


400 


327 


280 


284 


370 


271 


365 


286 
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